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Abstract 

We report some results on the quenched disordered Spherical multi-p-Spin Model 
in presence of ferromagnetic couplings. In particular, we present the phase di- 
agrams of some representative cases that schematically describe, in the mean- 
field approximation, the behavior of most known transitions in glassy materials, 
including dynamic arrest in super-cooled liquids, amorphous-amorphous transi- 
tions and spin-glass transitions. A simplified notation is introduced in order to 
compute systems properties in terms of an effective, self-induced, field encoding 
the whole ferromagnetic information. 



1. Introduction 

In the very extended framework of complex systems, spin glasses have be- 
come the source of ideas and techniques now representing a valuable theoret- 
ical background in diverse fields, with applications far beyond the physics of 
amorphous materials (both magnetic and structural). These systems are char- 
acterized by a strong dependence from the details, so strong that their behavior 
cannot be rebuilt starting from the analysis of a single cell constituent. Their 
analysis cannot be carried out without considering the collective behavior of 
the whole system. One of the common features is the occurrence of a large 
number of stable and metastable states or, in other words, a large choice in the 
possible realizations of the system. This goes along with a rather slow evolu- 
tion through many, detail- dependent intermediate states, looking for a global 
equilibrium state (or optimal solution). Mean-field models have largely helped 
in comprehending many of the mechanisms yielding such complicated structure 
and also have produced new theories or combined among each other old concepts 
pertaining to other fields such as, e.g., the spontaneous breaking of the replica 
symmetry and the ultrametric structure of states. Among mean-field models. 
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spherical models - i.e., continuous dynamic variables with a global constraint 
[1]- are analytically solvable even in the most complicated cases. 

Multi-p-spin spherical models have been shown to yield low temperature 
amorphous phases that, depending on the dominant interaction terms, can 
both be described by discontinuous and continuous Replica Symmetry Breaking 
(RSB) Ansatze. In particular, (i) one step replica symmetry breaking (IRSB) 
phases were studied, because of their relevance for the structural glass transition 
[2, 3, 4, 5], (ii) two step RSB phases [6, 7] are found that are thermodynami- 
cally stable and whose dynamics models secondary relaxation in glass-forming 
liquids (sec, e.g., [8] and for a thorough overview [9] and references therein) 
and study the singularities in the phase diagrams predicted by the mode cou- 
pling theory [10, 11, 12], (iii) the Full RSB phase represents spin-glasses in the 
proper sense and, more generally, the frozen phase in random manifold problems 
[13, 14, 15, 16, 17]. The possibility of the existence of Full RSB in spherical mod- 
els was first pointed out by Nieuwenhuizen [18] on the basis of the similarity be- 
tween the replica free energy multi-spin models and the relevant part of the free 
energy of the Sherrington-Kirkpatrick model. In Refs. [19, 20] thermodynamic 
stable Full RSB phases have been actually computed and analyzed. Spherical 
models, thus, also provide a much simpler realization of this Ansatz than in the 
spin-glass mean- field prototype model, i.e., the Sherrington-Kirkpatrick model 
[21]. 

Further inchiding ordered interaction terms representing attractive ferro- 
magnetic couplings between spins, one can use these models to study diverse 
problems, such as disordered systems along the Nishimori line [22, 23], or the 
states following problem[24, 25, 26], else the random pinning with a system 
at a very high temperature, or in presence of external random constraints, as, 
e.g., in porous media [27, 28, 29]. Spherical models with competing disordered 
and ordered non-linear couplings also describe mode-locking laser models, where 
spherical spins are used to represent both real and imaginary parts of the com- 
plex amplitude of photonic modes [30, 31, 32]. In particular, they can be used 
to address the problem of random lasers [33, 34], whose statistical mechanics 
description involves interactions between modes that are both non-linear and 
partially quenched disordered [35, 36]. In the latter case, we notice that the 
global spherical constraint on continuous variables is not implemented to ap- 
proximate discrete spin variables or ease the computation of the properties of 
continuous spins of fixed magnitude (like XY or Heisenberg spins), but it rep- 
resents the total amount of energy that an external pumping laser beam forces 
into the random laser to activate its modes. 

We will show in this work that adding purely ferromagnetic terms to the 
quenched disordered ones (a particular case of which is to have quenched disor- 
der with non-zero average) can be simply encoded into adding an effective field 
to the purely disordered system. The paper is organized as follow: in Sec. 2 we 
introduce the model and present a formal solution in the framework of Parisi 
Replica Symmetry Breaking Theory for the general case; in Sec. 3 we specialize 
the analysis to the s + p case in an uniform external field; in Sees. 4 and 5 we 
study the behavior in presence of ferromagnetic couplings of two qualitatively 



2 



different models both yielding RS and IRSB phases: the 3 + 4 and the 2 + 3 
models; in Sec. 6 we consider Replica Symmetry Breaking phases with contin- 
uous breakings and in Sec. 7 we show an explicit case in which these phases 
appear, even in presence of competing ferromagnetic interactions. Eventually, 
in Sec. 8 we show the termperature vs. degree of order phase diagrams for the 
2+p and the 3+4 models, where the degree or order is yielded by a combination 
of ferromagnetic interaction magnitudes. A word of caution. When the phase 
is described by a step-like order parameter function, as the IRSB phase, or it 
possesses a step- like part, the transition between different phases can differ if 
one considers the static or dynamic properties of the model [2, 3, 37, 38]. When 
they are distinct one speaks of the static and dynamic transitions. In the main 
text we shall consider only the static transitions. The changes associated with 
the dynamic transition will be briefly discussed in Appendix B. 



2. The Model 

We consider the general model system described by the spin-Hamiltonian 

(fc) 

p>2ii<---<ip k>l ii<---<ife 

with both quenched, independently distributed, Gaussian ]>spin interactions of 
zero mean and variance 



2jvp-i ' ^ ' 



(k) 

and uniform fc-spin interactions Jq , with the k = 1 term representing the 
interaction with an external uniform field. The scaling of the interaction with 
the system size N ensures the correct thermodynamic limit N oo. The 
spins are real continuous variables ranging from — oo to +oo, subjected to the 
global spherical constraint J2i ^1 = ^^^^ limits the fluctuations and makes 
the partition function well defined. The dynamics of the case with a single p> 2 
term and k = 2 was treated in Ref. [39]. 

The model can also be seen as a spherical multiple-spin interaction Spin 
Glass model with random couplings of non-zero average. The formulation (1) 
is, however, more general since it gives more freedom in choosing the interactions 
in the disordered and ordered part of the Hamiltonian. To stress this point we 
have deliberately used different indexes, namely p and k, for the disordered and 
ordered interactions. 

In the present study we shall consider the sub-class of models where only two 
terms, one with s and one with p > s interactions, are retained in the disordered 
part. These models have been called spherical s + p models [19, 20, 40, 41, 6]. 
The hallmark of these models are different phase diagrams depending on the 
values of s and p. Representative values of s and p will be discussed when 
needed. 
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2.1. The partition sum and replicas 

The static properties of the model are obtained from the free energy com- 
puted for fixed interactions and then averaged over the disorder. This quenched 
free energy can be computed using the replica trick: one first computes the 
annealed free energy density $(n) of n non-interacting identical replicas of the 
system by rising the partition sum Z = Tr„ e~^^ to the n'th power and aver- 
aging it over the disorder: 

$(n) = - lim In [Z"] . (3) 

The quenched free energy density $ is then obtained from the continuation of 
$(n) to non-integer values of n down to n = 0: 

$ = - lim lim (fZ"] - 1) = lim $(n). (4) 

In the last equality we assumed that the thermodynamic limit N ^ oo and 
the replica limit n — )• can be exchanged. The calculation of [Z"] is rather 
standard, so we report the main steps, just in order to introduce our notation. 
The interested reader can find more details in Refs. [42, 5]. By introducing the 
collective variables 

i i 

where a,b = 1, . . . , n are replica indexes, with qaa = 1 from the spherical con- 
straint, the leading contribution to [Z"] for A'' ^ oo can be written as 

j I?[g,A,rn,y]e-^^[9'^''"'^l, ^ oo (6) 

where 'D[q,X,m,y] cx U^^^dqat I\a<b ^«-bl\a'^'>^o-l\ad'ya denotes integrations 
over all (free) variables and 



G[q,X,m,y] = -^'^g{qab) -'^K{ma) + ^'^XabQab + Vama 

ab a ab a 

+ilnDet(-A) + i^y„(A-i)„62/6. (7) 



2 ' ' 2 

ab 



We have introduced the short-hand notation: 

p>2 



9{q) = ^^q^, /Xp = f/3^Jp^ (8) 



K(m) = ^6,m^ bp =^4'^ (9) 



k>l 
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In the thermodynamic hmit N ^ oo the integrals can be evaluated using the 
saddle-point approximation, leading to 

= lim - Extr G[q, ml (10) 
n^o n 

with ^ ^ 

G[q,m\ = -^^g{qab) - ^K{ma) - -Trln(g'a6 - niamb) (11) 

ab a 

The functional G[q,m] must be evaluated at its stationary point that, as n ^ 0, 
gives the maximum with respect to variations of qab and the minimum for vari- 
ations in nia ■ The variables Xab and ya have bc;en eliminated via the stationary 
point equations. In the expression (10) we have not included a constant term 
/3$o that comes from neglected 0{N) terms. This fixes the zero temperature 
value of energy and entropy, but it is not relevant for the study of the phase 
diagram. 

Since we are interested into the limit n ^ 0, the expression of G[q, m] can 
be simplified further by noticing that 

TV In (gab - mavrib) = Trlng - ^ ma(g"^)a6 + O(ri^) (12) 

ab 

so we arrive at the final expression 

G[q,m] = -]^^g{qab) -^n{ma) - ]p:v\nq+ i ^ mo(g~^)afe Wb + O(n^). 

ab ci ab 

(13) 

By imposing stationarity of G[q, m] with respect to variations with respect to 
rUa and qab {a 7^ b) we obtain the stationary point equations: 

b{ma) =J2(l^^)'^bmb (14) 

5 

Hqab) + {q~^)ab-^{q^^)acmc^iq~'^)bcmc = 0, a^h (15) 

c c 

To solve these equations we observe that eq. (14) can be inverted to give 

ma = ^qabb{'^b)- (17) 

b 

If we retain only the k = 1 term in K{m), then b{m) = bi. The equation 
becomes nia = bi qab and does not depend on the replica index a. This 
remains true in the general case because there are no explicit replica symmetry 
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breaking fields. The stationary point equation for the magnetization iria = m 
then becomes 

n 

m = 6(m)^^(;afe Va=l,...,n (18) 

6=1 

and the stationary point equation for Qab 

Hqab) + {q-')ab + bimf = a ^ b. (19) 

Note that if we consider the value of b{m) as given, that is b{m) = b, Eq. (19) 

reduces to that of the model in an external uniform constant field h = Tb. This 
a rather important technical point because we can split-up the resolution of 
the stationary point equation into two steps. First we solve eq. (19) assuming 
b{m) = b as fixed. Next we look for m solution of eq. (18) such that b{m) = b. 
In the following we will generically refer to b as "field" . 

2.2. Parisi Param,etrization: Replica Symmetry Breaking 

To solve the self-consistent stationary point equation (19) an assumption on 
the structure of the overlap matrix Qab must be done. As the n replicas of the 
real system are identical, one may reasonably assume that the solution should be 
symmetric under the exchange of any pair of replicas. In the high temperature 
(or field) case this holds true, and the solution is of the form 

Qab = Sab+ - Sab)qo- (20) 

This form of Qab is known as the Replica Symmetric (RS) solution. 

As the temperature (and field) decrease the symmetry under replica ex- 
change is spontaneously broken, and the overlap matrix becomes a non-trivial 
function of the replica indexes. In this regime the RS assumption is not valid and 
a more complex structure arises. Following the parameterization introduced by 
Parisi [43, 44], the overlap matrix qab for R steps of replica permutation symme- 
try breaking - called RSB solution - is divided along the diagonal into successive 
blocks of decreasing size Pu, with po = n and Pr+i = 1, and elements given by: 

qab = qanb = qu, u = 0,...,R+l (21) 

with 1 = g_R+i > qR > ■ ■ ■ > qi > qo- In this notation u = aOb denotes the 
overlap between the replicas a and b, and means that a and b belong to the 
same box of size p„ but to two distinct boxes of size Pu+i < Pu- 

The case R = gives back the RS solution, while the limiting case i? — > oo 
produces the solution called Full Replica Symmetry Breaking (FRSB or oo-RSB) 
solution [44, 45]. In this limit qu~qu~i — ^ for u = I, . . . , R, and the matrix qab 
is described by a continuous, non-decreasing function q{x), where, in the Parisi 
parameterization, x varies between and 1. Solutions with a finite value of R 
are called i?-RSB solutions [45, 5, 40, 41, 6]. These solutions can be described 
by a step- like function q{x). Mixed-type solutions, with both discontinuous R- 
RSB-type and continuous FRSB-type parts for some x interval, are also possible 
[19, 20]. 
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Inserting the form (21) into the free energy functional G[q, m], eq. (13), with 
TUa = TO, one obtains 
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-G[q,m] = -5(1) - ^(p„ -p„+i)5(g„) - ln(l - gfl) 

it=0 

_Vlln^-^!I^-2«(TO) (22) 
where g„ is the Rephca Fourier Transform (RFT) of qab [46, 47]: 

R+l 

qu = ^ Pv {qv - qv-i)- (23) 

v=u 

The free energy functional can be conveniently expressed by introducing the 
auxiliary function 

R 

xiq) =Po + Y^ {Pu+i - Pu) 0{q - Qu) (24) 

u=0 

which gives the fraction of pair of replicas with overlap qab < 9- In terms of 
x{q) the functional G[q,m] takes the form 

2 da 

-G[q,m] = -J^ dqx{q)K{q)- _^ _ ln(l - g^) + _ _ 2k(to) (25) 

X{q)= f dq'x{q'). (26) 

Jq 

Note that xiQu) = qu+i and, moreover, x{q) = xiQo) = x(0) ior < q < qo 
since x{q) = for q G [0, go]- 

The stationary point equations arc obtained from the first variation of the 
free energy functional G[q,m] with respect to x{q) and to: 



where 



-6G[q, m] = - [ dq F(q) Sx(q) - 2 
n Jo 



5m (27) 



where 



and 

R R 

6x{q) = ^ [9{q - g„_i) - 9{q - g„)] 6pu - ^(p„+i - Pu)S{q - g„) 5g„. (29) 

u—l u—0 

Stationarity of G[q, to] with respect to variations of to, g„ and Pu gives: 

m = x{qo) b{m) (30) 
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F{qu) = 0, u = 0,...,R 



(31) 



dqF{q)=0, u=l,...,R. (32) 



The function F{q) is continuous, thus eqs. (31) and (32) require that between 
any two successive pairs (g^-i, 9u) there must be at least two extrema of F{q). 
Denoting these by q*, the extrema condition F'{q*) = implies that 



where the prime denotes the derivative with respect to the argument q. The 
function x(q) is a non-dccrcasing function of q, and the left hand side of this 
equation is, thus, a concave function. The solutions to this equation, thus, 
depend from the convexity properties of l/-\/A'(g): in the region where it is 
concave a continuum of solution can be found, while where it is convex only 
discrete solutions exist. In the first case we deal with a continuous solution 
of the FRSB-type, while in the second case with a R-RSB-type solution. If 
1 / y/JVjq) changes concavity for different intervals of q, we have a mixed-type 
solution. 

In the above argument the presence of the ordered part of the Hamiltonian 
does not play any role, once encoded into h{m). In this way one can decouple the 
computation studying the behavior of a model in a (self-induced) "external" field 
apart from the relationship between the field and the magnetizations induced 
by the ferromagnetic couplings. 

The value of the field only enters in setting the value of q^, the lowest possible 
value of q{x). As a consequence, the value b of 6(m) fine-tunes the range [go, Qb\ 
where solutions of the stationary point equations must be searched. Since go is 
an increasing function of b the presence of an effective field b can only reduce the 
"complexity" of the solution found in absence of it. In particular, by increasing 
the value of b we can eventually force go = g_R, that is a transition to the RS 
solution. For larger value of b only the RS solution exists. 

If terms besides the fc = 1 term (the uniform external field) are present in 
the ordered part of the Hamiltonian, cf. Eq. (9), what we just said is only part 
of the game. In this case, indeed, 6(m) is a function of m, and we must consider 
the possible solutions to Eq. (30) such that 

b{m) = b (34) 

to unfold the complete solution. The unfolding depends on the form of b{m). 
Therefore, starting from the same phase diagram expressed as function of b, 
different phase diagrams can be produced in the coupling constants, depending 
on the actual b{m). An explicit instance of complete phase diagrams in T, J(*'P) 
and Jq**'^^ can be found in Ref. [26] and the cases 2+p {p> A) and 3-1-4 will be 
reported in Section 8. In the forthcoming part of the paper wc shall, instead, 
address the fate of the different type of solutions as the value of the effective 
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field is varied. To illustrate the results, wc shall study s + p models in presence 
of an external uniform field b described by the stationary point equations (18), 
(19). Stability of the stationary point requires that the quadratic form 

- ^ A'(g„6) {Sqabf + Tr {q-'5qf , (35) 

ab 

must be positive (semi) definite, where dqab = ^Qba is the fluctuation of from 
the stationary point value. 



3. The Spherical s + p model in an uniform external field 

The Spherical s + p model is the particular model obtained from the general 
Hamiltonian (1) in which one retains only two terms with random ,s-spin and 
p-spin interactions and a (fc = 1) uniform external field in Eq. (1). Without 
loosing in generality, we assume s < p from now on. For this model we have: 

9{q) = ^q' + ^q^, A(g) = + Mp^^'S (36) 

s p 

K{m) = bm 

The phase diagrams in the plane {fip,Hs), i-e- for b = I3h = 0, are well 
known [20] . Depending on the value of s and p different type of solutions can 
be found, of both FRSB and R-RSB type and mixed. Since we are interested 
on the effect of the external field b on these different phases, it can be useful to 
use the following parametrization 

A(9)=Mp(r-g^-'+9^-') (37) 

where 

r=^ = -4, 0<r<oo (38) 
Hp pJ^ 

gives the relative strength of the s and p interaction terms, and we use and 
b as free parameter for given r. The temperature, when needed, is computed as 
T/Jp = Vp/(2Mp). 

3.1. The RS Solution 

All models, regardless of the value of s and p, for large enough temperature 
(i.e., small enough /i^ and ^p) present a RS phase. The equation for the RS 
phase are obtained inserting 

x{q) = 0{q - qo) (39) 

into equations (30), (31) and (32), or into the functional (25), then making it 
stationary with respect to m and go- In either cases one ends up with: 

m = (1 - qofb (40) 
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and 

The RS phase remains stable as long as the relevant eigenvalue Ai of the fluc- 
tuations remains positive: 

Ai = -A'(go) + > 0- (42) 

(.1 - <lo) 

Using the stationary point equation (41) one obtains the equivalent condition 

A{qo) - goA'(go) + 6' > 0. (43) 

The equal sign defines the critical line on which the RS phase ends. With the 
help of the parameterization (37) the parametric equation of the critical line 
reads: 



(l-9o)2 r-(s-l)gr' + (p-l)9g"' 

Us =riip < go < 1 (44) 



h2 _ 



1 r{s - 2)9^1 + {p- 2)qP-' 



(l-go)V(.-l)gr' + (p-l)ar' 
Depending on the values of fXp and fXs, the curve may show points where 



db 



(45) 



that is dT/dh = in the {h, T) plane. When present, one of such critical points 
occurs where the transition between the RS phase and the RSB one changes 
from continuous to discontinuous. A discontinuity of finite height appears in 
q{x) at the transition and the critical line (44) stops there. 

By using the parametric form (44), the points where d^p/db = correspond 
to the value of solution of 

2A'(go) + (<Zo - l)A"((Zo) = 0. (46) 

The largest solution < < 1 of this equation, when it exists, gives the critical 
point where the line (44) ends, and go gets restricted to qc < qo < I- For r = 
we recover qc = 1 — 2/p , while it is = 1 — 2/s in the opposite limit r — >• oo. 
This is the critical value of the pure p-spin, or s-spin, spherical model. Beyond 
this point one must resort to a IRSB Ansatz in order to obtain the expression 
for the transition line. 
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3.2. The IRSB Solution 

The IRSB phase is described by a function x{(i) of the form 

x{q) =xe{q-qo) + {l-x)9{q-qi) 



(47) 



with X e [0, 1] and < qo < qi < 1. By plugging this expression into the free 
energy functional G[q, m] (25), and equating to zero its derivatives with respect 
to qo, qi, X and m, or directly into the stationary point equations (30), (31) and 
(32), we obtain the IRSB (static) equations 



A(go) 



9o 



A(gi) - K{qo) 



91 - 90 



9{Qi)-gi<lo) 



x(9i)x(9o) 

1 



Xiqoy 



and 



where 



xxilo) 
x{Qo)b 

Qi, x(9o) = l- 



m 



+ ^In 


'xiqiY 




.x{qo). 


qi + x{qi 


- qo)- 



= 



(48) 

(49) 

(50) 

(51) 
(52) 



For the purpose of the (numerical) solution of these equations, it is convenient 
to transform eq. (50) into the equivalent expression 



9{qi) - 9{qo) - Hqo){qi - qo) 



{qi - qo) [A(gi) 
where y = x{qo)/x{qi) e [0, 1] and 

z{y) = -2y 



Hqo)] 



z{y) 



l-y-\ny 



(53) 



(54) 



is the CS z-function [5]. The advantage of equation (53) over (50) is that it 
does not depend on temperature. With the parameterization (37) it depends 
only on the ratio r — iis/^J.p. Wc; can thcin easily solve the IRSB equations for 
fixed r, and x. The procedure is quite standard. One first introduces the ratio 
t = qo/qi S [0, 1] to be used as free parameter, and rewrite 



51 = 



1-2/ 



l-y + xy{l - 1)' 



x{qo) = 



x{l-t) 



l-y + xy{l - t) 



(55) 



and qo = tqi, x(<i'i) = Vxiqo)- With this replacements eq. (53) becomes function 
of y and t, besides r and x. Next one fixes the values of r and x, and solve 

equation (53) for y by varying t € [0, 1]. In this way one obtains y = y{t;x,r), 
that plugged into eqs. (49) and (48) gives the corresponding ij.p{t;x,r) and 
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b{t;x,r). This procedure builds the a;-line for the IRSB phase in the space 
{/ip, fj,sj b) on the plane r = fXs/fjip. 

The a;-line with x = 1 plays a special role. This line is the critical line 
separating the IRSB and RS phases. The transition is discontinuous in q{x) 
along the whole line since t = qo/qi < 1, and becomes continuous only at the 
end point t — )• 1. 

The stability analysis of the IRSB stationary point shows that the IRSB 
solution is stable provided the eigenvalues 

aW = -A'(9i) + ^ (56) 
A(^) = -A'(,o) + ^ (57) 

are both positive. 

To illustrate the phases and the transition we shall now consider some explicit 
examples. 



4. The 3 + 4 model 

This model is the prototype of a system with only RS and IRSB phases 
separated by a discontinuous transition line. Indeed for s = 3, p = A and b = 
eq. (43) reduces to 

that can be satisfied only for qo = 0. For qo = the eigenvalue Ai, eq. (42), 
reduces to Ai = 1 > 0, and RS solution with (70 = is stable everywhere for 
6 = [20]. However, for large enough /X3 and /X4 a IRSB phase with a favorable 
free energy appears. The transition between the two phases occurs along the 
a;- line with x = 1. The bottom-left inset in Figure 1 shows the phase diagram 
of the model for b = 0. 

The phase diagram in the full (/Lt4, /X3, b) space is reported in Figure 1. The 
lines, drawn for different values of r, define the critical surface separating the 
RS phase from the IRSB phase. The transition between the two phases is 
continuous on the part of the critical surface spanned by the full lines. This 
means that the difference qi — qo vanishes when approaching this portion of 
critical surface from the IRSB side. The breaking parameter x takes a value 
between and 1 depending on the intersection point. The transition turns into 
a discontinuous transition on the dashed part of the critical surface. Here the 
difference qi — qo remains finite as the critical surface is approached from the 
IRSB side, but a; = 1. Indeed, the discontinuous part of the critical surface is 
the surface spanned by the a:;-lines with x — I for different r. The two parts of 
the critical surface join each other along the end point line, where diJ,i/db\r = 0. 
Along this line 



90 = 91 = ?c = 



3(1 - r) + V9r2 + 6r + 9 , re[0,oo). (59) 
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Figure 1: Phase diagram of the 3 + 4 model in the , fig , b) space (center). The hnes are 
the critical hnes drawn for different values of r. Full black line: continuous transition; Dashed 
black line: discontinuous transition. The discontinuous and continuous transition surfaces 
join on the end point line where dfj,-j/db\r = 0. Left inset: projection on the 6 = plane. 
Right inset: projection on the r = 3/4 plane (grey lines, green online); the dot is the end 
point dfi4/db\r = 0. 



and 



1 



1 



6^ = 



(1 - 2rqc + 3g2 

1 rqc + 2ql 
(1 - qcf 2rq, + 3g2 



(60) 
(61) 



while ^3 = r 1^4 

In the bottom-right inset of Figure 1 we report a shce of the phase diagram 
taken for fixed r — 3/4, though the plot is generic for all r. It is similar to the 
phase diagram of the pure p-spin spherical model in an external field. Indeed, by 
varying r we smoothy interpolate between the pure 3-spin and 4-spin spherical 
model in a field. 

The scenario just described remains valid for all values of p > s > 3, provided 
the difference p — s is not to large. ^ 

5. The 2 + 3 model 

In the 3 + 4 model the transition between the RS and IRSB phases at small 
fields is always discontinuous. Next in phase diagram complexity sits the 2 + 3 
model. For 6 = this model posses a phase diagram with only RS and IRSB 



^When s <^ p a, 2RSB phase arises in the frozen phase [6, 7]. 
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1 2 3 4 5 1^3 

1^3 



Figure 2: Phase diagram of the 2 + 3 model in the {113, ^2, b) space. The hnes are the critical 
lines drawn for different values of r. Full line (red online): continuous transition; dotted 
line (red online): discontinuous transition; the end point line joining the discontinuous and 
continuous critical surfaces hits the 6 = plane at the point (1,1,0). Bottom (left) inset: 
6 = projection; the transition between the RS and the RSB phases is continuous along the 
full line, and discontinuous along the dotted line. Two x-lines of the IRSB are also shown. 
All X-lines ends on the continuous transition line where qi = qo = and Ai = A'^^ = 0. 
Top (right) inset: projections on r = 3/2 (light grey full and dotted lines, green online) and 
r = 1/5 (black line) planes, from bottom to top. For r < 1 the discontinuous line merge into 
a continuous line (red dot). At r = 1 the continuous transition line hits the /13 axis with an 
infinite slope. For r > 1 no discontinuous transition exists. 



phases but, at difference with the 3 + 4 model, the transition can be either 
continuous or discontinuous, see the bottom-left inset of Figure 2. 

When s = 2, and p generic, the stability condition (43) for & = becomes 

-^^pip~2)qP-' >0 (62) 

that again is satisfied only for qo — 0. However, at difference with the 3 -f 4 
case, the relevant eigenvalue now reads Ai = 1 — //2, and vanishes for /i2 = 1. 
Along this line the RS phase (/i2 < 1) becomes unstable against a IRSB phase 
(/i2 > 1), and a continuous transition between the two phases occurs. The 
continuous transition line ends at the point (/is, 112) = (I7 1) where the line hits 
the IRSB a;-line with x = l [19, 20]. 

Figure 2 shows the phase diagram of the 2 + 3 model in the space {^13,^12, b). 
The RS and IRSB phases are separated by a critical surface. The transition 
can be either continuous, on surface spanned by full lines, or discontinuous, on 
surface spanned by dotted lines. The continuous and discontinuous parts of the 
critical surface are joint along the end point line where dfi3/db\r = 0. Here 

1 - r 

9o = 9i=9c = — r<l (63) 
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and 

while /U2 = r 113. 

For r > 1 the transition between the RS and IRSB phases can only take 
place continuously, with go ^ 91 ^ on the critical surface. In Figure 2, wc 
show slices of the phase diagram on the planes of constant r above and below 
the critical value of r = 1. 



1 1 

(1 - q^y r + 2q^ 

_J: 9±_ 

(1 - ge)2 r + 2ge 



(64) 
(65) 



6. FuURSB 

Moving to models more complicated than those mentioned above one can 
study the RSB in its continuous limit, as introduced by Parisi to solve the 
Sherrington-Kirkpatrick model. That is, even in spherical models, one finds 
glassy phases whose correct thermodynamics can be computed only in this limit. 
The FRSB phase is described by a continuous order parameter function q{x) of 
the form 

{go = q{xo) 0<x<Xo 
q{x) xq < X < xi (66) 

qi = q{xi) xi <x <1 

see Figure 3, solution of the stationary point equations 

fi da' 

A{q)-A{qo) = / — qo < q < Qi (68) 

with x{q) given by eq. (26). To solve these equations we take the derivative of 
eq. (68) with respect to q, leading to 

A'(9) = ^> qo<q<qi- (69) 
By using this relation into eq. (67) we obtain the equation 

= - A(9o) = go A'iqo) - A{qo) (70) 

that solved for qq = qo{b) (or b — &(<Zo)) fixes the lower bound of q{x). To find 
the continuos part of q{x) we observe that from the definition of x{q)^ eq. (26), 
simply follows that x'{q) = ~x{q)- As a consequence taking the derivative of 
the relation (69) we have 

A"(g) = -^x'(g) ^ Xiq) = l^^^, q,<q<q, (71) 
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Figure 3: Schematic form of the order parameter function q{x) in the FRSB (left) and IFRSB 
(right) phases. As Qc = qi the two functions have equal form. 



which gives the explicit analytic form of x{q). Once inverted, it leads to the 
continuous part of q{x). Inserting now the value of go = Qoib) obtained from eq. 
(70) into x{q) from cq. (71) wc have xq = xIqq) = .to(6). 

To find the upper bound value qi of q{x), and xi, we observe that xili) = 
1 — qi. As a consequence, from eq. (69) evaluated for q = qi we obtain 

that fixes the value of qi. The value of xi follows as xi = x{qi). 

6.1. The IFRSB Solution 

The IFRSB solution differs from the FRSB for the presence of a discontin- 
uous part in the order parameter function q{x): 



q{x) = < 



qo = q{xo) Q< X <Xo 
q{x) Xo<x<Xc 
qc = q{xc) Xc< X < xi 



qi xi < x < 1 

as schematically shown in the right side of Figure 3. The stationary point 
equations for the IFRSB are a "mix" of those for the IRSB and FRSB, and 
read: 

A(go) = ^\^-b' (74) 



dq' 



w N w X r dq' 

A(g)-A(go) = J qo < q < qc 

qi - qc 
x{qi)x{qc) 



(75) 



A(gi)-A(ge) = ^V^T (76) 



where, see eq. (26), 

X(gi) = l-qi, x{qc) = l-qi+xi{qi- qc) (77) 
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and ^ 

Xil) = I - qi + xi{qi - qc) + / dq' x{q'), qo < q < qc- (78) 

Jq 

The position of the breaking point Xi follows from the equation 

^ 9{qi)-9{qc) - {qyqc)A{qc) ^^^ ^ (79) 
{qi - qc)[A{qi) - A{qc)] ^ ' 

where y = x(ac)/x(gi) e [0, 1]. 

The IFRSB solution reduces to the FRSB solution for qc = qi or xi = 1. 
In the former case the transition is continuous, and discontinuous in the latter. 
When go = qc the IFRSB solution goes over a IRSB solution. 

Similar to the FRSB solution, only qo (and xq = x{qo)) depends on b. All 
other quantities remain unchanged by varying b. As a consequence, since go 
grows with b (with ^p's held fixed) eventually go = 9c and we observe a transition 
between the IFRSB and the IRSB phases. 



7. The 2 + p model 

The prototype model with both FRSB and IFRSB phases is the 2 + 4 spheri- 
cal model. The model belongs to the family of 2 + p spherical models with p> 3 
whose phase diagram presents RS, IRSB, FRSB and IFRSB phases. The phase 
diagram reproduced in the full (/X4,/X2,^) space is shown in Figure 4, where 
the four different phases and relative transition lines are indicated. Its 6 = 
projection is shown in the bottom-left inset. 

We now discuss the conduct of each phase when the field b is switched on. We 
first analyze the FRSB and IFRSB phases, then the RS phase, and, eventually, 
the IRSB phase. 



Critical r* values Phases (transition kinds) 



RS, FRSB (continuous) 

ri'' =6 

RS, FRSB, IFRSB (continuous) 

r^°' = 0.6382 

RS, IRSB, FRSB, IFRSB (continuous) 
r\^^ = 0.375 

RS, IRSB, FRSB, IFRSB (cont. and disc.) 
r^°' = 0.2378 

RS, IRSB (cont. and disc.) 



Table 1: Boundary values of r = fi-z/fJ-i between different kinds of (/i4,6) phase diagrams. 

The top index in r^^ is the value of t = qo/qi = 0, 1, the sub-index is the value of a; = 0, 1. 
See Fig. 4 for a graphical representation. 
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Figure 4: Phase diagram of the 2 + 4 model in the fi2, fii, b space. Dark grey full line 
(red online): RS-IRSB continuous transition. Dark grey dotted line (red online): RS-IRSB 
discontinuous transition. Grey dashed line (blue online): IRSB-IFRSB continuous transition. 
Light grey full line (green online): RS-FRSB continuous transition. Black full line: FRSB- 
IFRSB continuous transition. Black dashed line: FRSB-IFRSB discontinuous transition. 
Bottom Left: 6 = projection. On the FRSB-IFRSB transition line (black) Qc = Qi, while 
on the IFRSB-IRSB transition line (dashed grey/blue) qc = 0. The transition line between 
the RS and the IRSB phases (dark grey/red dotted) is the x-line with x = 1. The tiny dotted 
black lines on the b = plane denote different values of the {fi4, b) plane at fixed r = ^2/ t^-A- 
Each plot is generic for a given interval of r values. Boundary values are shown in Tab. 1. 
From Top Right to Bottom Mid, clockwise: phase diagrams of the 2 + 4 model in the plane 
{^lA,b) with fixed r = 7.0,0.52,0.34 and 0.17. 



7.1. 2+p: FRSB phase 

The FRSB solution is known to reproduce the low temperature phase of the 
2+p model at 6 = [48]. In this special case, equations (67)-(71) become: 



90 = 



Mp(p- 2) 



^ 1 MP-l)(P"2)g""^ 
2 [^,2 + l^p{p~l)qP-^f' 



Ai2 +Mp(p- = 



1 



(80) 

(81) 
(82) 



At > the FRSB may exist only if the ratio r — 112/ ^p\s larger than the 

critical value rj"' , cf. Tab. 1. When the field h is switched on only go is modified: 
it becomes non-zero and grows with fc^/I^P^^^ c.f.r equation (80). Increasing b 
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for fixed /i2 and fip, wc eventually have qo = qi and a continuous transition 
from the FRSB to the RS phase takes place. In Figure 4 the RS-FRSB critical 
surface for the p = 4 case is the one spanned by the light grey (green) lines. 
For any {fii,b) slice with r > r^'' the FRSB phase is bounded exclusively by 
the RS phase, see top inset of Fig. 4. At r = r'^^ a boundary with the IFRSB 
phase first appears, the relative critical surface is the one spanned by the black 
lines in Fig. 4. The transition can be either continuous, if r^^^ < r < r^^ (full 
continuous lines, see also the inset for r = 0.52 in Fig. 4), or discontinuous, if 
r^'' < r < r^^'' (dashed lines, cf. inset of Fig. 4 for r = 0.34). 

7.2. 2 + p: IFRSB phase 

The IFRSB phase may exist only if r[°^ <r < r^^\ cf. Tab. 1 The fate of 
the IFRSB phase in a field is similar to that of the FRSB phase because the field 
b only affects the value of qo ^ Ip/ip^^), As a consequence, for b large enough, 
9o = Qc and the IFRSB phase goes over the IRSB phase. The transition is 
clearly continuous. The IFRSB-IRSB surface is the one spanned by tlic^ grc^y 
(blue) dashed lines in Fig. 4 and insets. The other boundary of the IFRSB 
phase is with the FRSB phase. The transition between these two phases can be 
either discontinuous or continuous, depending on r being smaller or larger than 
r\^^ , as we mentioned above, discussing the FRSB phase. We note that for 6 = 
the IFRSB phase is bounded by the IRSB phase only when r^^^ < r < Tq^K 
See, in Fig. 4 the insets for r = 0.52 and r = 0.34. 

7.3. 2+p: RS phase 

The field b has an ordering effect on the system, i.e., for large value of b the 
RS phase is the stable phase, c.f.r. eq. (43). When h is decreased the disordered 
terms in the Hamiltonian become more and more relevant and, depending on the 
value of /X2 and /tip, the RS phase may become unstable towards a more complex 
phase. This happens when the relevant eigenvalue Ai becomes negative, see 
eq. (42). The vanishing of Ai defines the critical RS surface, whose parametric 
equation is given by eq. (44) for s = 2. In Figure 4 for p = A this surface is 
the one spanned by the light grey (green online) and dark grey (red) full lines. 
If the value of b is further decreased one enters into either the FRSB phase, 
crossing the light grey (green) lines in figure, or the IRSB phase, crossing the 
full dark grey (red) lines in figure. The transition is in either case continuous. 
Which phase may be reached as the field b varies depends on the ratio r between 
the coupling coefficients /U2 and fip. For r > Tq^'' only the FRSB phase can be 
encountered, see top inset of Fig. 4 for p = 4, while for r < r^^ only the IRSB 
phase is feasible: see bottom inset of Fig. 4. In between {r^^ > r > rf^^) both 
IRSB and FRSB are possible, see insets for r = 0.34 and r = 0.52 in Fig. 4. 

The continuous RS critical surface may bend, and become multivalued, if 
dup/db = for fixed r. This occurs when g'o equals the largest solution < 
qc{r) < 1 of 

f{q) = pip - l)gf-2 - (p - l)(p - 2)gf-3 + 2r = 0, (83) 
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c.f. eq. (46) for 3 = 2. For large enough r this equation has no physical solutions. 
They do appear when r is sufficiently small. For r = we have gc(0) = {p—2)/p. 
To find the critical value of r we observe that f{q) ~ —{p — l){p — 2)qP~^ for 
g ~ 0+ while f{q) ^ p{p — 1)?^"^ for g ^ 1. Hence, there must be at least one 
minimum f'{q*) = with q* > 0. A simple calculation yields q* = {p — 3)/p. 
This, with /(O) = 2r, implies that, if r is not too large, equation (83) has at least 
two solutions with g > 0, and the surface may bend. Since increasing r shifts 
/(s) upwards, a crossover value of r is obtained by imposing that f{q*) = 0. 
This leads to 

1 2pP-3 V ^ 

The value qdr) for r < r[^'^ defines the end point line where the surface bends. 
For the special case 2 + 4 reported in Fig. 4, eq. (83) can be explicitly solved 
and one finds 

Icir) = Y^[^ + V9 - 24rJ , r < r*'^ = 3/8. (85) 

When the continuous RS critical surface bends, the transition between the RS 
and the IRSB phases becomes discontinuous on the end point line qdr). This 
line is the dark grey (red) line joining the contact points between the full and 
dotted dark grey (red) lines in Figure 4. Below this line the transition between 
the RS and IRSB is discontinuous and occurs on the critical surfaces spanned 
by the .x-line of the IRSB phase with x = 1. This is represented by dark grey 
dotted lines in figure 4 (see insets for r = 0.17,0.34). 

We note that since the surface is bended there is an inverse transition in h. 
That is, by decreasing b we can enter the IRSB phase from the RS phase via 
a continuous transition and, decreasing further 6, leave the IRSB phase for the 
RS phase again via a discontinuous transition. 

74. 2+p: IRSB phase 

The IRSB phase is found for large enough ^2 and e.g. the bottom-left 

inset of Fig. 4 for the 2 + 4 model with & = 0. When b increases qo grows and 
eventually becomes equal to qi. Here the IRSB phase ends. Since as go qi 
the second IRSB equation (49) reduces to the critical condition Ai = of the 
RS phase, c.f.r cq. (42), one enters into the RS phase through the continuous 
RS-IRSB transition, the surface spanned by the dark grey (red) full lines in Fig. 
4. This critical surface bounds the IRSB from "above". 

As discussed for the RS phase, if the ratio r between ^2 and is smaller 
than the critical value r^^^ the critical surface Ai = bends. Where this happens 
the transition between the IRSB and RS phases takes place with a finite value 
of qi — go and occurs when we cross the surface spanned by the x = 1 lines of 
the IRSB solution. In Fig. 4 this is represented by the surface spanned by the 
dark grey (red) dotted lines. 

If the ratio r exceeds the critical value r^^ the eigenvalue Aq^^ may become 
negative for low b, and the IRSB phase is unstable with respect to a IFRSB 
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phase. The transition between the IRSB and the IFRSB phase occurs on the 
critical surface defined by Aq"^^ = 0. 

This critical surface intersects the 6 = plane along the critical line of 
equation, see Appendix A, 

_ (1 - yo + xyof 

= ^'-y° + ^y°^\ (87) 



where yo solution of 



. ^ 2+(i>-2)ijo 
z[yo) = - 



P 

This is shown as dashed grey (blue) lines in Figure 4. Along this line the ratio 

r = H2/Hp is given by 

{l-y,+xyoy-^ ^''^ 

and varies between 

r(°) = yo(l - y^y-^ (90) 

for a; = 1 and 

= (91) 

1 - yo 

for a; = 0. For r in this range both FRSB and IFRSB phases, beside the IRSB 
phase, may exist, see inset of Fig. 4 for r = 0.34. 

When x = 1 the critical hne intersects both the RS-IRSB and RS-FRSB 
critical lines at the multi-critical point. For r < r^°^ only the RS and IRSB 

phases exist, see inset of Figs 4 for r = 0.17. 

In the opposite limit a; = both /ip and /i2 diverge, while its ratio r remains 

finite. As a consequence for r > r^^ '' only a IRSB phase with qo ^ Q may exist, 
provided r < r-Q^^ (see below), cf. r = 0.52 inset of Fig. 4. The numerical values 

for p = 4 are: yo = 0.389571, r^°^ = 0.2378, r^°^ = 0.63819. 

The breaking point x cannot exceed 1, implying that the IRSB critical sur- 
face is bounded by the x-line with a; = 1 (dark grey/red dotted line in Figure 
4). This line intersects the & = plane at the end point of the IRSB-IFRSB 
critical line on the 6=0 plane and gives the continuation to 6 7^ of the critical 
RS-IRSB line found on the 6 = plane. 

The other boundary of the IRSB-lFRSB critical surface occurs when qi = 
go, and the discontinuity associated with the IRSB (and IFRSB) solution disap- 
pears. The equation of the critical end line of the IRSB-lFRSB critical surface 
reads, see Appendix A, 

. 2 [p 3 + i,r 

27 (p-l)(p-2)(p-3)P-3a;2 ^ ' 
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p (p-3 + 3.t)^ 
^' = 27 (p-2)x^ 

2 _ ^ (p-3)^(p-3 + 3x) 
~ 27 (p-l)ar2 " ^^^> 

By varying a; between and 1 we obtain the critical line where the RS-IRSB- 
IFRSB-FRSB phases meet altogether. This is represented as a dark grey/red 
full line for r > r|^'* in Figure 4, see also the r = 0.52 inset. Along this line the 
ratio r is given by 

p(p-i) ip-sy-^ 

varying between r\^\ of. Eq. (84) for a; = 1, and 

r« = P(P-')(P-'r-' (96) 

for a; = 0. 

When X = 1 the line meets the critical a;- line with x = 1. Hence, a discon- 
tinuous RS-IRSB transition can be found only if r < while the transition 
is always continuous for r > r^^\ as shown in the (/i4, h) diagrams at fixed r in 
Fig. 4. 

As it occurs along the IRSB-IFRSB surface, for a; = both fip and /i2, as 

well as 6, diverge. The ratio r, nevertheless, remains finite. As a consequence, 
the IRSB phase cannot bo found if r > and only the FRSB phase survive, 
see Fig. 4. For p = 4, r^^^ 3/8 and rg^^ = 6. 

8. Phase diagrams of the s-\-p model in the ferromagnetic interaction 
strength 

The spherical s -\- p model with ferromagnetic interactions is the particular 
model described by 

A(5) = lJiaq^~^ + Afp«^"\ k{m) = hsm" + hpivF (97) 

where, as usual, it is assumed p > s. 

Next to equations (37-38) it is convenient to introduce the parameterization 

K{m) = bp {^m' + mF) (98) 

where 

P Jq 

gives the relative strength of the s and p interaction terms, and use and bp 
as free parameter for given r and 7. We do not consider the case of competing 
ferro-antiferromagnetic interaction (7 < 0), but the extension is straightforward. 
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With this parameterization the "unfolding equations" b{m) = b and m = 
x{Qo)b, cf. equation (34) and Sec. 2.2, yield 



7 / \ 

bp = — — -— - — — — = — — (100) 

Xyqo) K ym) I m X[Qo) ism-'^ -\- pmP ^ 

which, with eqs. (48)-(51), gives bp as function of SG parameters q = {qo, q\,. ..} 
and fi = {^p, Ha} in the case of an uniform external field. 

The natural parameters /Xp and bp can be transformed into the physical 
parameters that give the temperature and the strength of the ferromagnetic 
part by setting 



and 



Jl = aJ'^, J2 = (l-a)j2, a= (101) 

J^^=aoJa, = {1 - ao) Jo, ao = (102) 

pi + rsi 

where J and Jo measure the overall strength of the disorder and ferromagnetic 
parts. One then has 



f,p = iaP'j' ^ T/J=J^ = ,I ^ '\ (103) 



^0 OT T P^- 



6p = -^/3Jo ^ Jo = —Tbp = {p\+^s\)Tbp. (104) 
P'- ao 

For fixed temperature T, or /Xp, the Ferromagnetic (FM) solution m^O first 
appears at the critical value 

Jg = min Jo(q,/i). (105) 

90 — 

For Jo < Jq only the Paramagnetic (PM) solution to = is possible. 

The PM/FM transition can be either continuous or discontinuous in m. If 
the minimum of Jq occurs for g'o = 0, 

J^ = Mq,fi)U=o = JS (106) 

which corresponds to the case of zero external field in the associated model and 
hence to = 0, then 

TO ^ as Jo ^ Jo"^ (107) 

and the PM/FM transition is continuous. 

If, on the contrary, the minimum occurs at a finite value of qo, then to ^ 
at Jg and the FM phase appears discontinuously. In this case the critical point 
Jq in general corresponds to a spinodal point, where the solution first appears. 
The true thermodynamic (discontinuous) transition occurs at Jq > Jo*, where 
the free energy $ of the PM and FM solutions become equal. 
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8.1. The2+p Model 

From the form of the unfolding equation (100) we see that a continuous 
transition, i.e. a finite Jq, is possible only if s = 2, when the first m disappears 



from the denominator so that bp is finite for m = 0: 



bp 



m=o 27x(0) 



(108) 



leading to 

_ 27+^ _T_ 
27 X(0) 

The explicit form of Jc depends on the structure of the solution of the associated 
problem with zero external field b. If for the given temperature T (or fXp) the 
6=0 phase is Replica Symmetric (RS) then x{Qo) = ^ -~ Qo, and 

JS = ^^^T, (RS) (110) 

In the case of a one-step rephca symmetry (IRSB) phase x{Qo) = 1 — Qi+x{qi — 
go) and 



Finally if the phase is FRSB or IFRSB, then x(go) = l/\/A'(go) and x(0) = 
1 / ^/^2, leading to 

^° = ^ \/^' (FRSB/IFRSB) (112) 

If for a given T, or fip, the minimum of Jo occurs at a physically accciptable 
finite qo with Jq < Jq, then there is a spinodal point and the transition turns 
discontinuous. Besides the boundary values of go, the minimum of Jq may occur 
at the the stationary point of bp-. dbp/dqo\ij, = 0. A straightforward calculation 
for the 2+ p case yields 



dbp 
dqo 



(113) 



(27 + pmP ^)^x(go)^ 

x|27x'(go) +p[go - (P- l)x'A(go)]x'(go)m^'-^ 

+fc^[l-X^(gQ)A'(gQ)]x(go)m^-4| =0 

where 

= go - x(go)'A(go) (114) 



In Fig. 5 we report the phase diagram in the (T, Jo) plane for p ~ A, 
r = 0.340 and 7 = 0.8246. Up to some temperature dependent threshold value 
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Figure 5: Phase diagram of the 2 + 4 model in the T, Jo plane for r = 0.340 and 7 = 0.8246. 
The transition between the PM phases (m = 0) and the FM phases {m ^ 0) is continuous 
in m up to the tricritical point. Above this point the transition between the paramagnetic 
phase, denoted RS_PM, and the ferromagnetic phase, denoted RS_FM, is discontinuous with 
a finite jump of m along the transition line (full line in figure) . The transition is accompanied 
by the appearance of a ferromagnetic spinodal line (dashed line in figure). 



of the "ordering parameter" Jq/J, the phases have m = ("PM" phases in 
Figure 5) and are described by the 6 = Umit of the solutions discussed in the 
previous Sections. As Jq/J increases, phases with m 7^ (FM phases in Figure 
5) appear. For low enough temperature the transition between the PM phases 
and the FM phases occurs continuously with m vanishing at the transition. 
When the temperature is raised one eventually hits a tricritical point where the 
transition turns discontinuous. Above this temperature the transition occurs 
with a finite jump in m on the transition line (full line in Figure 5), and is 
accompanied by the presence of a spinodal line where the m 7^ first appears 
(dashed line). Interestingly, there exists a range of Jq where, upon cooling, the 
system goes from a high temperature paramagnetic phase to a low temperature 
IRSB spin glass phase with rn = passing through intermediate FM phases. In 
this case no continuous transition occurs between the PM and the FM phases. 
This transition is the counterpart of the IRSB/RS transition that occurs in the 
model with a uniform external field. 

When s > 2 then 6p — >■ 00 as m — )■ and the transition between PM and FM 
phases can occur only discontinuously with a jump in m.^ As an example in Fig. 



^ A similar scenario also occurs for 2 + p models if 7 = 0. 
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Figure 6; Phase diagram of the 3 + 4 model in the T, Jq plane for r = 0.340 and 7 = 1. The 
transition between the PM phases (m = 0) and the FM phases (m 0) is always discon- 
tinuous with a finite jump of m along the trajisition line (full line in figure). The trajisition 
is a<;compaiiied by the appearance of a ferromagnetic spinodal line (dashed line in figure). 
The inset shows the transition line (dash-dotted line) between the (metastable) ferromagnetic 
IRSB phase that appears at the spinodal line (dashed line) and the (metastable) ferromag- 
netic (RS) phase. The latter becomes the thermodynamic stable phase at the transition line 
(full line on the rhs.). 



6 we show the phase diagram of the 3 + 4 model for r = 0.75 and 7 = 1. Note 
the presence of a phase transition (dash-dotted hnc) between the (metastable) 
IRSB PM solution, which appears at the spinodal line (dashed line), and the 
(metastable) RS FM solution (see also inset in figure 6). 



9. Conclusions 

In this work we have studied the spherical multi-p-spin model with ferro- 
magnetic interactions. We formally add multi A;— body interaction terms with 
deterministic interactions next to multi p-body terms with quenched disordered 
couplings of zero average. A particular case of this set of interactions is to have 
quenched disorder with non-zero average. After recalling in detail the features 
of this class of models we have shown that adding purely ferromagnetic terms 
to the quenched disordered ones can be simply encoded into adding an effective 
field acting on the purely disordered system. More specifically, once that the 
presence of the ordered part of the Hamiltonian is encoded into a field, it does 
not play any role anymore and one can study the systems properties decoupling 
the analysis of the behavior of a model in a field from the computation of the re- 
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lationship between the effective field and tlie real magnetizations brought about 
by the ferromagnetic couplings. In the replica symmetry breaking parameters, 
the value of the field only enters in setting the value of the lowest value qo of 
the generic overlap function q{x). This is an increasing function of the field 
and, hence, the presence of the ferromagnetic contribution can only reduce the 
"complexity" of the solution found in absence of it. In particular, by increasing 
the value of the effective field we can eventually force the frozen solution to be 
a RS solution. 

We have detailed the analysis of some specific examples whose properties 
are, though, general. The simplest one is the 3 + 4 model, whose phase diagram 
is akin to a single j?-spin model. We then show the behavior of the 2 + 3 model, 
still displaying only RS and IRSB phases (both with and without ferromagnetic 
ordering) but whose transitions can be both discontinuous and continuous. On 
the warm side of the dynamic transition line this is a realization of the mode 
coupling Fi2 schematic theory [10, 11]. Eventually we exhaustively describe 
the behavior of the 2 + p model (with p > 4) where many phases of different 
complexity level arise: RS, IRSB, FRSB and IFRSB both with and without 
ferromagnetic ordering. In particular, a continuous breaking of the replica sym- 
metry is realized at low temperature and field in a given region of the phase 
space, cf. Figs. 2, 5 for the explicit case j? = 4. From a dynamic perspective 
the model is equivalent to a mode coupling F13 schematic theory [10, 11]. We 
note that the analysis has been performed using the static approach. When 
the phase is described by a step-like order parameter function q{x), such as 
in the IRSB phase, or it possesses a step-like part, as in the IFRSB phase, 
the location of the transition between different phases in the phase space can 
be different, if one considers the dynamic properties of the system. Roughly 
speaking this is a consequence of a the presence of a macroscopic number of 
metastable states that prevents the dynamics to reach the lowest (stable) state. 
The dynamical transition takes place at the point where the metastable states 
become dominant, and occurs before the static critical point is reached. As far 
as the phase diagram is concerned the differences between statics and dynamics 
are then mainly quantitative, not qualitative. In order not to dull reading with 
too many details we have not explicitly considered this difference in the main 
text. Nevertheless for completeness a brief technical discussion about dynamic 
equations and transition lines has been reported in Appendix B. 
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Appendix A. IRSB-IFRSB critical surface for the 2 + p model 

The IRSB equations for the 2+p model are 

P-l 90 ,2 /A i\ 

^^2qo + HpQo = -^j^ - b (A.l) 

where 

X(gi) = l-qi, xilo) = l-qi+ x{qi - qo) (A.3) 

and the breaking point x is fixed by equation (53). The IRSB phase is stable 
provided the eigenvalue eq. (57), is positive. This leads to the critical 

condition 

A'(go) = -At2 ^ /"2 + - l)9o"^ = -r-\2- (^-4) 

By introducing the ratio t = qo/qi ^ [0,1], and solving the equations for /X2 and 
Hp, we obtain the equation of the IRSB critical line 

„ = 1 [i-y + xy(i-t)F 

a;2y(l-t/)P-3(l-t) [l-(p-l)iP-2 + (p-2)iP-i] ^ ^ 

[^(l_^P-i)_(p_l)(l_t)tP-2] 

= x^i-tr ^^-^^ 

^_ [1 - y + a:y(l - t)]2 



[1 - (p - l)tP-2 + (p - 2)tP-i] 



,,2 = r„ [l-y + a:y(l-t)] 

' x^y{l-t) [1 - (p - l)iP-2 + (p - l)iP-i] ^ 

where y and t are related by the equation 

ziv) = i^ylp-2--pt+ptP-^-{p-2)tP] (A.8) 
+2 - p{p - l)tP-^ + 2p{p - 2)iP-i -{p-l){p- 2)if I 



■ p{l -t)[l-{p- l)iP-2 + (p - 2)iP-i] ■ 



and 



M2 ^ (1 - yf-' [y{l-tP-')-{p-i)tP-^] 

(1-t) [l-y + a;y(l-t)]P-2 " ^ ' ' 
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For the 2 + 4 spherical model the equations can be simplified as follows 



= (l-t)3(l + 2t)x2y ^^■^^> 



where y is solution of 



and 



Equation (A. 8), or (A. 13) for the 2 + 4 case, can be solved by fixing the value 
of either y or f in the range [0, 1], and solving for the other. Once x, y and t are 
known, /ip, /i2 and b are obtained from eqs. (A. 5), (A. 6) and (A. 7). The other 
quantities are given by 

91 = 1 ^ n x{qo) = z 1 ' A.15 

l-y + xy{l-t) l-y + xy{l-t) 

with qo = tqi, x{qi) = VXilo)- 

By fixing x and solving for y as function of t one finds the x-lines in the 
{fip,li2,b) space along which the IRSB phase becomes unstable. These are 
obtained by setting t = {qo = 0) into Eqs. (A. 5), (A. 6) and (A. 8), and are 
reported in Sec. 7, cf. Eqs. (86)-(88). 

In Sec. 7 we also report the boundary values ri*'* for which the constant r 
{H4,b) projections start displaying different phases, cf. Eqs. (84), (90), (91), 
(96). 

The IRSB-IFRSB critical surface ends when t = 1 where the discontinuity 
associated with the IRSB (and IFRSB) solution disappears. Solving equation 
(A. 8) in the limit f — )• 1~ we obtain 

y = l-P-^{l-t) + 0{{l-tf), t^l- (A.16) 

and 

gi = ^_^3~^^^ +Oil-t), qi-qo = 0{l-t), t^l-. (A.17) 

The equation of the critical end line of the IRSB-lFRSB critical surface are 
reported in Sec. 7, cf. Eqs. (92)-(94). 
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Appendix B. Dynamic transition 



When the solution is described by a step- like order parameter function q{x), 
such as in the IRSB phase, or it possesses a step-like part, as in the IFRSB 
phase, the location of the transition between different phases in the phase space 
can be different, depending one considers the static or dynamic properties of the 
system. This is a consequence of the appearance of a macroscopic number of 
metastable states that prevents the dynamics to reach the lowest (stable) state 
[49, 50, 51, 52]. In this case the dynamical evolution of the system is dominated 
by these metastable states and the system fails to reach the static critical point. 
The dynamical transition is associated with the point where the effect of the 
metastable states becomes dominant, and occurs before the static critical point 
is reached. 

We do not go into the details of a dynamical study of the model, but rather 
use a shortcut that allows us to recover the dynamical properties from the replica 
calculation described in the main text. This accounts for replacing the station- 
ary condition of the free energy functional G[q,m] with respect to variations of 
the breaking point x (or Xi for the IFRSB solution) by the (simpler) "marginal 
condition" 

a(^) = -A'(qi) + = (B.l) 



which describes the critical slowing down of the dynamics at the dynamic tran- 
sition point. The interested reader can find more details on this in, e.g., Ref. 
[38]. Once this replacement has boon done, the study of the phase diagram just 
follows the same mainlines of described in the main text for the static solution. 

For example by solving eqs. (49) and (B.l) we have for the IRSB phase of 
the s+p model the parametric equations: 



^ _^ (gj ^-Qq ^)Xo-(p-l)gr ^(gi-go)xi ,g 2) 

Xlxo is - l)qt-\<f,-' - - (P - !)??-'(??-' - go"') 



„ ^ ill ^-gp ^)X0 - (g - l)gl ^(gl-go)Xl /T3 o^ 

x?xo(p-i)gr(gr^-gr)-(«-i)gr(gr-gr^) ^ ^ ^ 

where xo,i = x(go,i)) which give [fisifJ-p) as function of {qo,qi,x). These equa- 
tions, with h obtained from cq. (48), give the complete description of the IRSB 
solution in the dynamic approach. 

In the limit g'l — g'o ^ the stationary condition used in statics and the 
marginal condition used in dynamics coincide, so that all "continuous transi- 
tion" are unchanged between static and dynamics. This is not true for the 
discontinuous transition where q\ — qo remains finite. To obtain the discontin- 
uous transition surface between the RS and IRSB phase, we take .x = 1 in the 
above equations and vary qi and go- This surface is qualitatively similar to 
the analogous surface discussed for the static, and, indeed, it joins the continu- 
ous transition surface along the same line discussed in the main text, but it is 
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everywhere else distinct from that. It crosses the 6 = plane along the line 



{s - - (,s - 2) 

which lies on the left hand side of the corresponding static line in the (/Ltj,,/Zs) 
plane. 

The critical surface between the IRSB and the IFRSB phases of the 2 + p 
model is obtained from the above equations by imposing the additional critical 
condition (A.4), which reduces the number of free parameters from 3 to 2. A 
straightforward calculations leads again to eqs. (A.5)-(A.7) with 

l_(p_l)^P-2 + (p_2)tP-i 

replacing cq. (A. 8). This surface intersects the continuous IRSB-RS transition 
surface along the same line discussed in the main text for the static, eqs. (92)- 
(94), and the 6 = plane on the line of equation (86)-(87) with j/o = l/(p — 2). 
The analysis for other cases is straightforward. 
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